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Abstract 

Compressed sensing (CS) and 1-bit CS cannot directly recover quantized signals and require time 
consuming recovery. In this paper, we introduce Hamming compressed sensing (HCS) that directly 
recovers a k-bit quantized signal of dimensional n from its 1-bit measurements via invoking n times 
of Kullback-Leibler divergence based nearest neighbor search. Compared with CS and 1-bit CS, HCS 
allows the signal to be dense, takes considerably less (linear) recovery time and requires substantially less 
measurements {OiXogn)). Moreover, HCS recovery can accelerate the subsequent 1-bit CS dequantizer. 
We study a quantized recovery error bound of HCS for general signals and "HCS+dequantizer" recovery 
error bound for sparse signals. Extensive numerical simulations verify the appealing accuracy, robustness, 
efficiency and consistency of HCS. 

Index Terms 

Compressed sensing, 1-bit compressed sensing, HCS quantizer, quantized recovery, nearest neighbor 
search, dequantizer. 

I. Introduction 

Digital revolution triggered a rapid growth of novel signal acquisition techniques with primary 
interests in reducing sampling costs and improving recovery efficiency. The theoretical promise of 
conventional sampling methods comes from the Shannon/Nyquist sampling theorem [IJ, which 
states a signal can be fully recovered if it is sampled uniformly at a rate more than twice 
its bandwidth. Such uniform sampling is always done by analog-to-digital converters (ADCs). 
Unfortunately, for many real applications such as radar imaging and magnetic resonance imaging 
(MRI), Nyquist rate is too high due to the expensive cost of analog-to-digital (AD) conversion, 
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the maximum sampling rate limits of the hardware, or the additional costly compression to the 
obtained samples. 

A. Compressed sensing 

Recently, prosperous researches in compressed sensing (CS) [|2]] [[3]] JH [[5l [[6]] Q show that an 
accurate recovery can be obtained by sampling signals at a rate proportional to their underlying 
"information content" rather than their bandwidth. The key improvement brought by CS is that 
the sampling rate can be significantly reduced by replacing the uniform sampling with linear 
measurement, if the signals are sparse or compressible on certain dictionary. This improvement 
leverages the fact that many signals of interest occupies a quite large bandwidth but has a sparse 
spectrum, which leads to a redundancy of the uniform sampling. In particular, CS dedicates to 
reconstruct a signal x G from its linear measurements 

y = = 

where $ G W^^^ is the measurement or sensing matrix allowing m <C n (in which case $ 
is an underdetermined system). The signal x is K-sparse if its nonzero entries are less than 
K. Given a dictionary x is X-compressible if the nonzero entries of a are less than K. If 
sparse/compressible x is the Nyquist-rate samples of a analog signal CS replaces ADCs 
with a novel sampler $ such that ^ = $x = A straightforward approach for recovering 

X from y is to minimize the number of nonzero entries in x, i.e., the £o norm of x. Specifically, 
it is not difficult to demonstrate that a X-sparse signal x can be accurately recovered from 2K 
measurements by solving 

min ||x||q s.t. y = $x (CS^) 

with exhaustive search if $ is a generic matrix. However, such exhaustive search has intractable 
combinatorial complexity. So some CS methods adopts iterative and greedy algorithms to solve 
the £o minimization, such as orthogonal matching pursuit (OMP) [SJ, compressive sampling 
matching pursuit (CoSaMP) [|9]], approximate message passing [ITOl . iterative splitting and thresh- 
olding (1ST) El and iterated hard shrinkage (IHT) 1(13. 

Since £q minimization is a non-convex problem, some other CS methods solve its convex 
relaxation, i.e., £i minimization and its variants: 

min s.t. y = ^x. (CS/-,) 
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Various convex optimization approaches have been developed or introduced to solve the above 
problem and its variants. Representatives include basis pursuit lfT3ll , Dantzig selecter [fT4l . NESTA 
ifTSll . interior point method [|T6l . coordinate gradient descent ifTTl . gradient projection [fT8l| and 
the class of approaches based on the fixed point method such as Bregman iterative algorithm 
lfT9l , fixed point continuation Il20il and iteratively re- weighted least squares (IRLS) [21 J. It is also 
worthy noting that the lasso [22J type algorithms Il23lllf24ll for model selection can be applied 
to CS recovery problem as well. 

However, compared with the recovery schemes in conventional sampling theory, which recon- 
structs signals by invoking nearly linear transformation, most aforementioned recovery algorithms 
in CS methods require polynomial time cost, which is substantially more expensive than the 
conventional methods. This burden in recovery efficiency limits the applications of CS in many 
real problems, in which the dimension of the signals is extremely high. 

Beyond the recovery efficiency, another important issue in CS is the theoretical guarantee 
for precise recovery. Since most existing CS algorithm finds the signal that agrees with the 
measurements y without directly minimizing norm, the recovery success of existing CS 
methods relies on another theoretical requirement for $ (or in compressible case), i.e., 
two sufficiently close measurements yi = $xi and 7/2 = $X2 indicates that vectors xi and X2 
are sufficiently close to each other. This low-distortion property of the linear operator $ is called 
"restricted isometry property (RIP)" [25J[26], which can also be interpreted as the incoherence 
between the measurement matrix $ and the signal dictionary ^1 (or identity matrix / for sparse x) 
in order to restrict the concentration of a single ai (or xi in sparse case) in the measurements. An 
intriguing property of CS is that some randomly generated matrices such as Gaussian, Bernoulli 
and partial Fourier ensemble fulfill RIP with high probabilities. For example, $ whose entries 
are randomly drawn from a sub-Gaussian distribution satisfies RIP with a high probability if 
m = 0{K\og{n/ K)). By using the concept of RIP, the global solution of the li minimization 
with such $ is guaranteed to be sufficiently close to the original sparse signal. Thus CS can 
successfully recover K-sparse signals of dimension n from m = 0{K\og{n/ K)) measurements. 
However, given a deterministic $ with m = 0{K\og{n/ K)), it is generally regarded as NP-hard 
to test whether RIP holds or not. 

In practice, it is paramount that signals are not exactly sparse and the measurements cannot be 
precise due to the hardware limits. Questions arise in this case that "is it possible to recovery the 
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K largest entries if x is nearly sparse?" and "is it possible to recover x from noisy measurements 
yT\ These questions lead to the problem of stable recovery Il26lll27l in CS. Fortunately RIP can 
naturally address this problem, because it ensures that small changes in measurements induce 
small changes in the recoveries. In stable recovery, the constraint y = ^x in the original £o 
and £i minimization problems are replaced with ||^ — $x||2 < e. Another variant in this case 
is minimizing — $x||2 with penalty or constraint to £o or £i norm of x. Many existing CS 
algorithms such as basis pursuit denoising (BPDN) ifTSll can also handle the stable recovery 
problem. 

Today's state-of-the-art researches in CS focus primarily on further reducing the number 
of measurements, improving the recovery efficiency and increasing the robustness of stable 
recovery. Although CS ||28]| exhibits powerful potential in simplifying the sampling process 
and reducing the measurement amount, there are some unsettled issues of CS when applied to 
realistic digital systems, especially in developing hardware. A crucial problem is how to deal 
with the quantization of the measurements. 

B. Quantized compressed sensing 

In practical digital systems, quantization of CS measurements y is a natural and inevitable 
process, in which each measurement is transformed from a real value to a finite number of bits 
that represent a finite interval containing the real value. In CS, quantization is an irreversible 
process introducing error in measurements, if we round the quantized measurement as any 
real value within the corresponding interval in recovery. One commonly used trick to deal 
with quantization error is to treat it as bounded Gaussian noise in measurements, and thus 
stable recovery methods in CS guarantee to obtain a robust recovery. However, this solution 
cannot produce acceptable recovery result unless the quantization error is sufficiently small and 
near Gaussian. Unfortunately, these two conditions are often hardly fulfilled because 1) small 
quantization error is obtained from small interval width, which is the result of high sampling 
rate and high conversion accuracy of ADC. This conflicts with the spirit of CS; and 2) the 
quantization error is usually highly non-Gaussian. 

Several recent works ll29ll[30l[l3T1l[l32l address the quantized compressed sensing (QCS) by 
(implicitly or explicitly) treating the quantization as a box constraint to the measurements y = 
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min s.t. u<^x + e<v, (QCS) 

where the two vectors u and v store the corresponding boundaries of the intervals that the 
entries of y lit in, and e is the measurement noise. The box constraint is also called quanti- 
zation consistency (QC) constraint. By solving this problem, the quantization error will not be 
wholly transformed into the recovery error via RIP. Thus it is possible to obtain an accurate 
recovery from very coarsely quantized measurements. A variant of BPDN called "basis pursuit 
dequantizer" proposed in [29] restricts \\y — $x||^(2 <C p <C oc) rather than — $x||2 in £i 
norm minimization, and proves that the recovery error decreases by a factor of ^/p~+l. In 
[[32J, an adaption of BPDN and subspace pursuit |[33ll integrate an explicit QC constraint. An £i 
regularized maximum likelihood estimation is developed in ll30ll to solve QCS with noise (i.e.. 

As the extreme case of QCS, 1-bit CS |[3T1ll[34l has been developed to reconstruct sparse 
signals from 1-bit measurements, which merely capture the signs of the linear measurements in 
CS. The 1-bit measurements enable simple and fast quantization. Thus it can significantly reduce 
the sampling costs and strengthen the robustness of hardware implementation. One inevitable 
information loss in 1-bit measurements is the scale of the original signal, because scaled signal 
will have the same linear measurement signs as the original one. Theoretically, 1-bit CS ensures 
consistent reconstructions of signals on the unit £2 sphere Il35llll36ll . In 1-bit CS, one-sided £2 
|[3T1l or £1 [34 J objectives are designed to guarantee the consistency of 1-bit measurements by 
imposing a sign constraint or minimizing the sign violations in optimization. Analogous to RIP in 
CS, the binary e- stable embedding (BeSE) |[34ll ensures the low distortion between the original 
signals and their 1-bit measurements, and thus guarantees the accuracy and stableness of the 
reconstruction. It is remarkable that m = 0{Klogn) can guarantees BeSE and the subsequent 
successful recovery. Most 1-bit CS recovery algorithms, e.g., renormalized fixed point iteration 
im, matched sign pursuit [35 J and binary iterative hard thresholding (BIHT) ll34l , are extensions 
of CS recovery algorithms. It has been shown that BIHT, a variant of IHT IIT2I . can produce 
precise and consistent recovery from 1-bit measurements. 

QCS and 1-bit CS not only consider the quantization of the measurements but also improve 
the recovery robustness to the nonlinear distortions brought by ADC, because the quantized 
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measurements only preserve the intervals the real-value measurements lie in. However, QCS 
and 1-bit CS methods require polynomial-time recovery algorithms and thus they are prohibitive 
to high dimensional signals in practical applications. Moreover, another central problem is that 
either CS or QCS recovers the original real-value signals, but quantization of the recovered 
signals is inevitable in digital systems. 

C. Hamming compressed sensing 

Digital systems prefer to use the quantized recovery of the original signal, which can be 
processed directly, but the recoveries of both CS and QCS are continuous and real-valued. In 
order to apply them to digital systems, a straightforward solution is to impose an additional 
quantization to the CS or QCS recoveries. However, this quantization requests additional time 
costs and expenses on ADCs, which could be expensive if the sampling rate is required to be 
high. Moreover, the convex optimization or iterative greedy search based recovery in CS and 
QCS is of polynomial-time. This is not acceptable for high-dimensional signals. In addition, the 
trade-off between the recovery time and the recovery resolution cannot be controlled in CS and 
QCS, although it is preferred in practice. Finally, the success of CS and QCS is based upon the 
assumption that signals are sparse. When the signal x is dense, the numbers of measurements 
are large required by CS and QCS and the advantages of CS and QCS are lost accordingly. 

In this paper, we directly recover the quantization of a general signal (not necessary to be 
iC-sparse) from the quantization of its linear measurements, or "quantized recovery (QR)". In 
particular, for a signal x and its quantization g = by a quantizer Q( ), we seek for a 

recovery algorithm R{-) that reconstructs g* = R{y) sufficiently close to q from the quantized 
measurements y = A{x), where the operator ^4 is a composition of linear measurement and 
quantization. This problem has not been formally studied before, and has the potential to 
mitigate the aforementioned limitations of CS and QCS. The main motivation behind QR is 
sacrificing the quantization error of the recovery for reducing the number of measurements. 
Thus the recovery time can be significantly reduced with the decreasing of the number of bits 
for the quantized recovery, and the number of measurements can be small even when the signal 
is dense. Comparing with CS and QCS, QR considers the quantization error of the quantized 
recovery in determining the sampling rate and developing the reconstruction algorithm. 

The primary contribution of this paper is developing Hamming compressed sensing (HCS) 
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to achieve quantized recovery from a small number of quantized measurements with extremely 
small time cost and without signal sparsity constraint. In compression (sampling), we adopt the 
1-bit measurements |[34l to guarantee consistency and BeSE but employ them in a different way. 
In particular, we introduce a bijection between each dimension of the signal and a Bernoulli 
distribution. The underlying idea of HCS is to estimate the Bernoulli distribution for each 
dimension from the 1-bit measurements, and thus each dimension of the signal can be recovered 
from the corresponding Bernoulli distribution. In order to define the quantized recovery, we 
propose a k-bit HCS quantizer splitting the signal domain into k intervals, which are derived 
from the bijection as the mappings of the k uniform linear quantization boundaries for the 
Bernoulli distribution domain. In recovery, HCS searches the nearest neighbor of the estimated 
Bernoulli distribution among the k boundaries in the Bernoulli distribution domain, and recovers 
the quantization of the corresponding dimension as the HCS quantizer interval associated with 
the nearest boundary. We theoretically study a quantized recovery error bound of HCS by 
investigating the precision of the estimation and its impact on the KL divergence based nearest 
neighbor search. The theoretical analysis provide a strong support to the successful recovery of 
HCS. 

Comparing with CS and QCS, HCS has the following significant and appealing merits: 

1 HCS provides simple and low-cost sampling and recovery schemes for digital systems. 
The procedures are substantially simple: the sampling and sensing are integrated to 1-bit 
measurements, while the recovery and quantization are integrated to quantized recovery. 
Furthermore, both the 1-bit measurement and the quantized recovery do not require ADC 
with a high sampling rate. Note that HCS remains the recovery robustness due to quantized 
measurements inherited from QCS. 

2 The recovery in HCS only requires to compute nk KuUback-Leibler (KL) divergences 
for obtaining k-bit recovery of an n-dimensional signal, and thus is a non-iterative, linear 
algorithm. The recovery includes very simple computations. Therefore, HCS is considerably 
more efficient and easier to be implemented than CS and QCS. 

3 According to the theoretical analysis of HCS, merely m = (9(logn) 1-bit measurements are 
sufficient to produce a successful quantized recovery with high probability. Note there is no 
sparse assumption to the signal x. Therefore, HCS allows more economical compression 
than CS and QCS. 
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Another compelling advantage of HCS is it can promote the recovery of the real- value signals 
after quantized recovery. When the subsequent dequantization x* = after quantized 

recovery is required, we can treat the HCS quantized recovery as a box constraint to reduce 
the search space of the 1-bit CS dequantizer D{-) in order to accelerate the convergence. By 
invoking the HCS recovery bound, the consistency and BeSE from 1-bit CS, we show an error 
bound of "HCS+dequantizer" recovery for sparse signals. 

The rest of this paper is outlined as follows. Section 2 introduces the 1-bit measurements 
in HCS, which lead to a bijection between each dimension of the signal and a Bernoulli 
distribution, and its consistency. Section 3 presents the k-bit reconstruction in HCS, including 
how to obtain the HCS quantizer, KL-divergence nearest neighbor search based recovery and 
theoretical evidence for successful recovery. Section 4 introduces the application of HCS recovery 
results in dequantization, an theoretical analysis of the dequantization error is given here. Section 
5 shows the power of HCS via three groups of experiments. Section 6 concludes. 

n. 1 -BIT Measurements 

HCS recovers the quantized signal directly from its quantized measurements, each of which 
is composed of a finite number of bits. We consider the extreme case of 1-bit measurements of 
a signal x G M^, which are given by 

y = A{x) = sign ($x) , (1) 

where sign(-) is an element- wise sign operator and A(-) maps x from to the Boolean cube 
:= { — 1, 1}^. Since the scale of the signal is lost in 1-bit measurements y (multiplying x with 
a positive scalar will not change the signs of the measurements), the consistent reconstruction 
can be obtained by enforcing the signal x G := {x G S^~^ : ||x||o < K} where S^~^ := 
{x G : 11^ II 2 = 1} is the n-dimensional unit hyper- sphere. 

The 1-bit measurements y can also be viewed as a "hash" of the signal x. Similar hash based 
on random projection signs is developed in locality sensitive hashing (LSH) |[37lll[38l . LSH 
performs an approximate nearest neighbor (ANN) searches on the hashes of signals, and proves 
the results approach the precise NN searches on the original signals with high probability. This 
theoretical guarantee is based on condition similar to BeSE p34'| in 1-bit CS. It is interesting to 
compare LSH with HCS, because LSH is an irreversible process aiming at ANN, while HCS 
can be viewed as a reversible LSH in this case. 
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A. Bijection 

In contrast to CS and 1-bit CS, HCS does not recover the original signal, but reconstructs the 
quantized signal by recovering each dimension in isolation. In particular, according to Lemma 
3.2 in [39J, we show that there exists a bijection (cf. Theorem [T]) between each dimension 
of the signal x and a Bernoulli distribution, which can be uniquely estimated from the 1-bit 
measurements. The underlying idea of HCS is to estimate the Bernoulli distribution for each 
dimension, and recover the quantization of the corresponding dimension as the interval where 
the Bernoulli distribution's mapping hes in. 

Theorem 1: (Bijection) For a normalized signal x G with ||x||2 = 1 and a normahzed 
Gaussian random vector (j) that is drawn uniformly from the unit ^2 sphere in (i.e., each 
element of (j) is firstly drawn i.i.d. from the standard Gaussian distribution A/'(0, 1) and then 
(j) is normalized as (/)/||(/)||2), given the i^^ dimension of the signal xi and the corresponding 
coordinate unit vector = {0, • • • , 0, 1, 0, • • • , 0}, where 1 appears in the i^^ dimension, there 
exists a bijection P : M ^ P from xi to the Bernoulli distribution of the binary random variable 
Si = sign ((x, (/))) • sign ((e^, (/))): 

{Pr (si = —1) = - arccos (xi) , 
^ ^ \ ^ ^ (2) 

Pr (5^ = 1) = 1 — arccos (x^) . 

Since the mapping between x^ and P(x^) is bijective, given P(x^), the dimension of 
X can be uniquely identified. According to the definition of Si, P{xi) can be estimated from 
the instances of the random variable sign ((x, 0)), which are exactly the 1-bit measurements y 
defined in ([T]). Therefore, the 1-bit measurements y include sufficient information to reconstruct 
Xi from the estimation of P{xi), and the recovery accuracy of x^ depends on the accuracy of 
the estimation to P{xi). 

B. Consistency 

Given a signal x, its quantization q = Q{x) by HCS quantizer Q{-), the quantized recovery 
g* = R{y) obtained by HCS reconstruction R{-) from the 1-bit measurements y = A{x), and its 
dequantization x* = obtained by a dequantizer D{-), the "HCS+dequantizer" recovery x* 

is given by 

X* = X + errn + erru^ (3) 
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where errn is determined by the difference between q and g* caused by HCS reconstruction, 
and ervD is the dequantization error from to x*. The upper bounds of errn and err^ will be 
given in Sections 4 and 5, respectively. The following Lemma [T] shows the consistency pertaining 
to errn and erru- 

Lemma 1: (Consistency) Let $ be a standard Gaussian random matrix whose m rows are 
composed of defined in Theorem [Tj The measurement operator A{-) is defined in ([!]). Given 
a fixed 7 > 0, for any signal x G and its "HCS+dequantizer" recovery x*, we have 

E{DH{A{x^)^A{x)))<g{a,\\x\\2), (4) 
Ft{Dh (^(x*), > g{a, + ^) < e'^^^^ (5) 

where Dh{u,v) = ^ Yl^i^i ® {u,v ^ { — 1, 1}^) is the normalized Hamming distance, 

Proof: According to ([T]) and ([3]), we have 

A{x*) = sign ($x*) = sign ($x + $ {errn + erru)) . (6) 

Since err = $ (err/f + err^) is a Gaussian random noise vector whose i^^ element err^ ^ 
A/'(0,cr^). According to Lemma 5 in [34], we obtain Lemma [Tj This completes the proof. ■ 

The consistent reconstruction in CS and 1-bit CS minimizes \\A{x) — ^(x*)|| for a K-sparse 
signal X. RIP and BeSE bridge the consistency and the reconstruction accuracy in CS and 1-bit 
CS, respectively. Instead of minimizing ||^(x) — ^(x*)|| to achieve the recovery accuracy, HCS 
directly estimates the interval that each dimension of the signal x lies in from the estimated 
Bernoulli distribution defined in Theorem [TJ 

In addition, the consistency between A{x) and is important for HCS, because in part 

it determines 1) the amount of information preserved in 1-bit measurements, and 2) the error 
bound of "HCS+dequantizer" recovery for sparse signals. 

III. K-BiT Reconstruction 

The primary contribution of this paper is the quantized recovery in HCS, which reconstructs the 
quantized signal from its 1-bit measurements ([T]). Figure [T(a)l illustrates HCS quantized recovery. 



To define the HCS quantizer, we firstly find k boundaries Pj(j = 0, • • • , A; — 1) ([8]) in Bernoulli 
distribution domain by imposing the uniform linear quantizer to the range of P^. Given an 
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arbitrary x^, the nearest neighbor of P{xi) among the k boundaries Pj(j = 0, • • • , fc — 1) indicates 
the interval qi that Xi hes in the signal domain. The k + 1 boundaries Sj(j = 0, - • - ,k) associated 
with the k intervals qjij = 0, • • • ,k) are calculated from the k boundaries PjO' = 0, • • • , — 1) 
according to the bijection defined in Theorem [l| In HCS recovery, P(x^) is estimated as P{xi) 
from the 1-bit measurements y. Then the nearest neighbor of P{xi) among the k boundaries 
^jO = 0, • • • , — 1) is determined by comparing the KL-divergences between P{xi) and Pj. 
The quantization of xi defined by HCS quantizer is recovered as the interval qi corresponding 
to the nearest neighbor. 

In this section, we first introduce the HCS quantizer, which is a mapping resulting from the 
uniform linear quantizer of the Bernoulli distribution domain to the signal domain. The quantized 
recovery procedure is composed of n times of KL-divergence based nearest neighbor searches. 
Thus it is a linear algorithm much faster than the conventional reconstruction algorithms of CS 
and 1-bit CS, which require optimization with the ^^(0 < p < 2) constraint/penalty, or iterative 
thresholding/greedy search. We then study the upper bound of the quantized recovery error err^f . 

A. HCS quantizer 

Since HCS aims at recovering the quantization of the original signal, we firstly introduce 
HCS quantizer, which defines the intervals and boundaries for quantization in the signal domain. 
These intervals and boundaries are uniquely derived from a predefined uniform linear quantizer 
in the Bernoulli distribution domain. Given a signal and the boundaries of HCS quantizer, its 
k-bit HCS quantization can be identified. We will show HCS quantizer performs closely to the 
uniform linear quantizer. 

Note that in the quantized recovery of HCS, the reconstruction and quantization are simul- 
taneously accomplished. Thus the HCS quantizer will not play an explicit role in the recovery 
procedure. However, it is related to and uniquely determined by the quantization of the Bernoulli 
distribution domain, which plays an important role in the recovery and explains the reconstruction 
g*. Moreover, it will be applied to the error bound analyses for ervH and ervH + errn- 

We introduce the HCS quantizer Q{') by defining a bijective mapping from the boundaries of 
the Bernoulli distribution domain to the intervals of the signal domain according to Theorem [T] 
Assume the range of a signal x is given by: 

- 1 < Xinf <Xi< Xsup < 1, Vi, • • • , n. (7) 
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Fig. 1. (a) Quantized recovery in HCS. Bernoulli distribution P{xi) given in Theorem [l] has estimate P{xi) ( |12| ) from 1-bit 
measurements y — A{x). HCS searches the nearest neighbor of P^Xi) among the k boundaries Pj{j — 0, - - - , A: — 1) js} in the 
Bernoulli distribution domain. The quantization of Xi, i.e., qi is recovered as the interval between the two boundaries Si-i and 
Si corresponding to the nearest neighbor, wherein Si ([To| is a mapping of Pi-i and Pi in signal domain, (b) HCS quantizer. 
The boundaries Si in ^iO\ when k — 10, 30, 50, • • • , 510 and Xinf — —l^Xsup — 1. 



By applying the uniform linear quantizer with the quantization interval A to the Bernoulli 
distribution domain, we get the corresponding boundaries 

P~ = Pr (— 1) = - arccos ixinf) iA, 
i^+ = Pr(l) = l-Pr(-l). 
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The interval A is 

A = ( - arccos (xinf) - - arccos (xsup)] = j^—r (Pq - Pk) • (9) 

/c — 1 \Tl TT y /c — 1 

We define the k-bit HCS quantizer in the signal domain by computing its A; + 1 boundaries 

as a mapping from the k boundaries = 0, • • • , /c — 1) to M in the Bernoulli domain: 



Si=< 



coMi^T^h i = l,--- ,k-l; (10) 



where 



Although the mapping between the boundaries of HCS quantizer 5^^ to the boundaries of the 
quantizer in the Bernoulli distribution domain Pi is bijective, such mapping cannot be explicitly 
obtained. So it is difficult to derive the corresponding quantizer in the Bernoulli distribution 
domain from a predefined HCS quantizer. Thus HCS quantizer cannot be fixed as a uniform 
linear quantizer and has to be computed from a predefined quantizer in the Bernoulli distribution 
domain. Fortunately, HCS quantizer performs very closely to the uniform linear quantizer, 
especially when xi is not very close to —1 or 1. Figure [T(b)l shows the fact. 



Given a signal x and the boundaries defined in (10), its k-bit HCS quantization q is 



Q{x) = q,q^ = {j : < x, < S^} . (11) 



B. KL-divergence based nearest neighbor search 



The k + 1 boundaries of the k-bit HCS quantizer in ( [T0| ) define k intervals in M. Quantized 
recovery in HCS reconstructs a quantized signal by estimating which interval each dimension 
of the signal x lies in. The estimation is obtained by a nearest neighbor search in the Bernoulli 
distribution domain. To be specific, an estimation of P{xi) given in ^ can be derived from 
the 1-bit measurements y. For each P{xi), we find its nearest neighbor among the k boundaries 
Pj(j = 0, • • • , /c — 1) ([8]) in the Bernoulli distribution domain. The interval that Xi lies in is then 
estimated as the interval of HCS quantizer corresponding to the nearest neighbor. KL-divergence 
measures the distance between two Bernoulli distributions in the nearest neighbor search. 

October 11, 2011 DRAFT 



14 



(12) 



According to Theorem[Tj the bijection from Xi to a particular Bernoulli distribution, i.e., P(x^) 
given in ([2]), has an unbiased estimation from the 1-bit measurements y 

P{x,)- = Pr {s, = -1) = j -.[y- sign ($^)]^. = -1 /m, 
P{x,y = Pr {s, = l) = l- Ft {s, = -1) , 

where $^ is the i^^ column of the measurement matrix $. 

The quantization of Xi can then be recovered by searching the nearest neighbor of P{xi) 
among the k boundary BernouUi distributions Pj{j = 0, • • • ,k — 1) in ([s]). In this paper, the 
distance between Pj and P{xi) is measured by the KL-divergence: 

pr p+ 



Dkl {Pj\\P{xi)) = Pi log + P^ log 



Vi = I,-- - ,n,Vi = 0,--- ,fc-l. (13) 
The interval that xi lies in among the k intervals defined by the boundaries Sj{j = 0, • • • , fc) 



in (10) is identified as the one whose corresponding boundary distribution Pj is the nearest 
neighbor of P{xi). Therefore, the quantized recovery of x, i.e., g*, is given by 

R{y) = (f,(fi = l + ^Tgmm Dkl (^Pj\\P{xi)^ , 

Vz = l,... ,n,Vj =0,... ,fc-l. (14) 
Thus the interval that Xi hes in can be recovered as 

Sq--1 <Xi< Sq^. (15) 

The HCS recovery algorithm is fully summarized in ( [T4| ), which only includes simple computa- 



tions without iteration and thus can be easily implemented in real systems. According to ( [T4| ), the 
quantized recovery in HCS requires nk computations of KL-divergence between two Bernoulli 
distributions. This indicates the high efficiency of HCS (linear recovery time), and the trade-off 
between resolution (k) and time cost (nk). 

C. Quantized recovery error bound 
We investigate the error bound of the quantized recovery ( [T4| ) by studying the difference 



between qi (11) and g*, which are the quantization of xi and its quantized recovery by HCS, 
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respectively. The difference between q and defines the error ervH in ([3]), which is the error 



caused by HCS reconstruction ( p4| ): 

Sqi - Sql+1 < {qi - q* - 1) Amax, qi > <?*; 

|(errH),| = <^ 0, = g*; (16) 

Sq' - Sqi+l < (Q* - - 1) ^max, qi < q*i ■ 
V * 

The /S^max denotes the largest interval between neighboring boundaries of the HCS quantizer, 
i.e., A^ax = niaxj^i^... {Sj — Sj-i). 

In order to investigate the difference between qi and g*, we study the upper bound for the 
probability of the event that the true quantization of Xi is q^ = 1 + a, while its recovery by HCS 
is g* = 1 + 7^ a). According to the HCS quantizer ([TT]) and the HCS reconstruction ( [T4| ), 
this probability is 

Pr = argmin i^KL I < < . (17) 

In order to study the conditional probability in ([T7]), we first consider an equivalent event of 
/5 = argminL^xL shown in the following Lemma jlj 

Lemma 2: (Equivalence) The event that the nearest neighbor of P{xi) among Pj{j = 0, • • • ,k- 
1) is P/3 equals to the event that P{xi) is closer to than both P^_i and P^+i, where the distance 
between Pj and P{xi) is measured by KL divergence (13), i.e., 

/3 = argmmL^KL (^Pj\\P{xi)^ 

rr (Pr\\P(xA] > 0, 

(18) 



Dkl - Dkl (^Pp\\P{x,)^ > 0, 



Dkl - Dkl I^P^\\P{x,)^ > 0. 

Proof: It is direct to have the following equivalence: 

/3 = ^igminDKL {Pj\\P{xi)^ « Dkl - Dkl {P^\\P{xi)^ > 0. (19) 



Thus in ([18]) is true. In order to prove in ([18]), for arbitrary j G {0, • • • , - 1} 

and fixed Xi, we study the monotonicity of Dkl a function of P^: 

dp- ^\p{t.)- 1-p- ' 
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Therefore, it holds that 

dDKL{Pj\\P{x.)) f >0, i^r>P 



dPr 



' (21) 

<0, Pr<P{x,)-, 



According to the definition of Pj in ([8]) and the right hand side of "<^=^" in (18), we have 

^j"j=o,- -,/3-i ^ P{xi)~ that indicate 

Dkl (i",:,=o,..,/3-2||^(x.)) > Dkl | | > Dkl [p^\\P{x,)^ , (22) 

and ^^7j^/3+i,...,/e-i < P{xi)~ that indicate 



Therefore, we can derive the left hand side of from its right hand side in (18). This 

completes the proof. ■ 



By using the equivalence in Lemma [2} the conditional probability given in ( [T7| ) can be 



upper bounded by two other conditional probabilities, whose conditions are the two cases of 
the condition in ([17]). 



Corollary 1: (Upper bounds in two cases) The conditional probability given in ( [T7| ) can be 
upper bounded by 



Pr = argmmL^KL {Pj\\P{xi)^ \Sa<Xi< S^+i^ 



^ Pr [Dkl - Dkl {p^\\P{x,)^ > | 5, < < < S^^ , 

Pr [dkl - Dkl (^Pp\\P{x,)^ > | S^^i < < < . 

Proof: By using Lemma |2} we discuss the the conditional probability in ( [T7| ) by considering 
the two cases of the conditional event Sa < Xi < Sa^i- 
Case 1) When Sa+i < 5^^, we have 

Pr = ^Tgmin Dkl (^Pj\\P{xi)^ \ Sa < Xi < Sa+i^ 

= Pr (^Dkl - Dkl [Pp\\P{x,)^ > \ < x, < S^+i < 

Pr [Dkl - Dkl [p^\\P{x,)^ > | 5, < < < 

< Ft [Dkl - Dkl {p^\\P{x,)) > | 5, < < < 5^) . (25) 
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Case 2) When aS/^+i < aS^, we have 

Pr = argmini^xL I 5. < < ^c+i 

= Pr (^Dkl - i^xL > I S^^i < < x, < 

Pr (^Dkl - Dkl (^P^\\P{x,)^ > | S^^i < < < 

<Pr (Dkl (p^+i\\P{x,)) - Dkl (p^\\P{x,)) > | S^^i < < x, < 



(26) 

This completes the proof. ■ 
Hence we can bound the conditional probability in ([17]) by exploring the upper bounds of the 
two conditional probabilities in Corollary [TJ 



Proposition 1: (Two probabilistic bounds) The two conditional probabilities in ( [241 ) upper 
bounded by 



Pr ^Dkl [Pp-i\\P{x,)j - Dkl [Pp\\P{x,)j > \ < x, < S^^i < S^) < 
- exp —2m • — arccos ixi) 7 r 

Pr I^Dkl [Pp+i\\P{xi)) - Dkl (^Pp\\P{xi)^ > | S^+i < < Xi < S^+i ) < 
-exp —2m- — 7 r arccos (Xj) 



(27) 



(28) 



where / is defined as 



l/A 



(29) 



Proof: For proving (27), according to (13) and the definition of P{xi) in (12), we have 
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the following equivalences: 

Dkl (Pp-l\\P{Xi)] - DKL[Pp\\P{Xi)^ 



1 - P{x,)- 
-A log — 7. — ^ — log 



PixiY 



(l-^/3--A) 



(i-^/T-^) 



> 



Pixi)- < 



l/A 



/ ft-) 

j : [y ■ sign ($9] . 



- f (P-) = ^ 

1^^^^ l^(i^r + A)(^---)(l-i^r-A)(-^--) 



m 



f ft) + 1 



(30) 



where x denotes the largest integer smaller than x. 



Since 



j : [?/ ■ sign ($9]^. = -1 



refers to the event that in a sequence of m independent 
Bernoulli trials defined in (|2]), there are j trials return Sj = — 1, we can conclude the distribution 
of j follows the binomial distribution 



Pr J : [i/ • sign ($^]^. = -1 



1 y r 1 \"'-' 

— arccos (x,;) 1 ( 1 arccos(xj) . (31) 



m 

According to the equivalence shown in (30), the probability in (27) can then be computed as 



Pr i e 



0, 



m 



f ft-) + 1 



Since 



we have 



df {Pi) 



dPr 



E 

3=0 



= log 



— arccos [Xi) j (1 arccos [Xi) 



Pr + A 



l-Pr -A , 



< bg 7 r < 7 r = 771 ■ — aiCCOS 

- ^ / ft-) + 1 - / ft-+l) +1 ^ ^ ' 

Hence the condition of Hoeffding's inequality for probability (|32]) holds: 

m 1 , r< \ 1 

— 7 r < m ■ — arccos < m ■ — arccos (Xi) . 

f (P^) + 1 - TT ^ - TT ^ 



(32) 
(33) 

(34) 

(35) 



By applying Hoeffding's inequality to probabihty (32), we have 



Pr J e 



0, 



m 



f ft-) + 1 



< - exp —2m • — arccos (Xi) r — 

-2^1 U ^ /ft-)+l 



(36) 
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Due to the equivalence proved in (30), we obtain (27). This completes the proof of (27). 



To prove (28), similarly, according to (13) and the definition of P{xi) in (12), we have the 
following equivalences: 



, , 1 - Pixi)- 
A log — . ^ > 



DKL{Pp+l\\P{Xi)) - Dkl [Pp\\P{Xi)^ 



= log 



P{xi)- 



P{xi)- > 



m 



m 



(37) 



where x denotes the smallest integer larger than x. 

According to the equivalence shown in (37) and the binomial distribution given in ( [3T] ), the 
probability in (28) can be computed as 

Pr I i G 



m 



f- fei) + 1 



, m 



1 arccos (x^) — arccos (x^) 



TT 



m-j 



The monotonicity of / (P^ ) in (33) yields 



m 



m 



< m 



m 



= m [ 1 arccos (Sa) 

TT 



+ /(P-) + i 

Hence the condition of Hoeffding's inequality for probability ([38]) holds: 



m 



m 



< m ( 1 arccos (Sa)] < m (l arccos (xi) 



TT 



TT 



(38) 



(39) 



(40) 



By applying Hoeffding's inequality to probability (38), we have 



m 



, m 



< - exp I —2m 



1 



arccos (xi) 



(41) 



Due to the equivalence proved in (37), we obtain (28). This completes the proof of (28). ■ 
By using Lemma [2} Corollary [T] and Proposition [TJ we have the following Theorem about the 
upper bound of the probability in ( [T7| ). 



Theorem 2: (Quantized recovery bound) Given HCS quantizer Q{-) in (11) and HCS re- 
construction R{-) ([14]), the probability of the event that the true quantization of is = 1 + a 
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while its recovery by HCS is = 1 + (3(qi ^ q*) is upper bounded by 

Pt{[Q{x)]^ = q, I [R{y)]^ = g*) =Pt((3 = aigmin Dkl (PJ\\P{x^) 



Sry ^ Xi ^ S, 





|exp 


-2m • 1 


< < 








|exp 


-2m ■ 1 









+1 



^ arccos {xi) 



- arccos [x^ 




(42) 



The minimum amount of 1-bit measurements that ensures the successful quantized recovery 
in HCS is then directly obtained from Theorem [2} 

Corollary 2: (Amount of measurements) HCS successfully reconstructs Xi with probability 
exceeding 1 — rj (0 < rj < 1) if the number of measurements 



(43) 



where 

5j = min 



arccos {xi) 



— arccos (xj 7 r — 



(44) 



Moreover, HCS successfully reconstruct the signal x with probability exceeding 1 — 77 if the 
number of measurements 

1 Tl 

m > - — : — ^ log (45) 
2 mm^ Oi 2r] 



Remark: Corollary [2] states that the quantization of an n-dimensional signal x on the unit 
sphere can be successfully recovered by HCS from m = 0{logn) with high probability. 
Compared with CS and QCS, the amount of measurements required by HCS is substantially 
reduced and irrelevant to the sparsity of the signal. Thus HCS provides a simpler and more 
economical sampling scheme that does not rely on sparse or compressible assumption to the 
signal. 

A new issue in quantized recovery is the influence of quantization bits k to the recovery 



accuracy. According to the definition of Si in (44), both the upper bound for the probability 



of reconstruction failure in (42) and the least number of measurements ensuring reconstruction 



success in (43) will be reduced if \qi — g*| increases. This indicates two facts: 1) the interval 
Xi lies in is easier to be mistakenly recovered as its nearest intervals; and 2) when we increase 
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the number of bits k in quantized recovery, Xi will become closer to the boundaries Sq-i and 



Sq, which leads to the decreasing of min^5^ in (45). In this case, the number of measurements 



m has to be increased in order to ensure a successful recovery. In summary, recovering finer 
quantization in HCS requires an augment in the number of measurements. In another word, HCS 
performs a trade-off between sampling rate and resolution. 

IV. Dequantizer 

If required, we can dequantize the quantized recovery of the signal by assigning to x* the 
midpoint of the interval that Xi lies in, i.e., x* = | {Sq*-i + 5^^*). Although this dequantizer is 
simple and efficient, it is not accurate. 

Fortunately, existing 1-bit CS provides accurate tools for dequantization on the HCS quan- 
tized recovery result compared with the midpoint reconstruction, though they introduce extra 
computational costs to trade-off the efficiency against dequantization accuracy. That is because 
most 1-bit CS recovery algorithms invoke time consuming optimization with £p(0 < p < 2) 
penalty or constraint. However, the quantized recovery of HCS provides a box constraint to the 
subsequent 1-bit CS optimization, and thus significantly reduces the time costs by shrinking the 
search space for x*. 

In particular, we obtain the following box constraint to the signal x from the HCS quantized 
recovery g*: 

n= {x: Sq^-i <Xi< Sq^ } . (46) 



Since Q in ( [46| ) is convex, the projection to it is direct 

Vn {x) = z,Zi = median {Sq^^i.Xi, Sq^ } , (47) 



The dequantization can then be obtained by adding a projection step ( [47| ) at the end of 
each iteration round of 1-bit CS recovery algorithms. Note the 1-bit CS algorithms with this 
modification have a substantially smaller searching space, so they will converge quickly. Note x* 
has to be normalized to x* := x*/||x*||2 at the end of the dequantization, because x is assumed 
to be on the unit £2 sphere. 
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A. HCS+dequantizer error bound 

We analyze the error of "HCS+dequantizer" recovery based on the fact that both the error 
ervH caused by HCS reconstruction and the error err^ caused by a dequantizer can be upper 
bounded. In the worst case, the upper bound of the dequantization error erro is 

\{erTD),\ < 5,* - = 1, • • • (48) 

Based on the consistency in Lemma [TJ the definition of BeSE ll34l and Lemma of amount of 
measurement ll34ll . we derive the upper bound of "HCS+dequantizer" recovery error when the 
signal is K-sparse in the following Theorem |3| 

Definition 1: (Binary e-Stable Embedding) Let e G (0, 1). A mapping A : ^ {-1, 1}^ 
is a binary e-stable embedding (BeSE) of order K for sparse signals if 

Ds{x, X*) - e < Dh (A(x), A(x*)) < Ds{x, x*) + e, Ds{x, x*) = - arccos(x, x*). (49) 

71 

for all X-sparse signals x, x* on the unit £2 sphere. 

Lemma 3: (Amount of measurements) Let $ be the measurement matrix defined in Theorem 
[Tj and let the 1-bit measurement operator A{-) be defined as in (|T]). Fix < /i < 1 and 6 > 0. 
If the number of measurements is 

m > 4 ( Klogn + 2Klog — +log- ) , (50) 

then with probability exceeding 1 — /x, the mapping defined by 74( ) is a BeSE of order K for 
sparse signals. 

Theorem 3: (HCS+dequantizer error bound) If x* = = D{R{y)) = D{R{A{x))) 

is the "HCS+dequantizer" recovery of X-sparse signal x, where y includes m measurements 



whose amount satisfies (50), then 



Ds (x, X*) < Dh (^(x), ^(x*)) + e<J^+7 + 6, (51) 
where a, 7 are defined in Lemma [T] 

V. Empirical study 

This section compares HCS and compare it with BIHT |[34l for 1-bit CS on 3 groups of 
numerical experiments. We use average quantized recovery error Y^^=i ~ \ /^^ measure 
ervH shown in Section 3.3. In each trial, we draw a normalized Gaussian random matrix $ G 
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Fig. 2. Phase plots of HCS and "1-bit CS+HCS quantizer" in the noiseless case. 



j^mxn gjy^j^ jj^ Theorem [T] and a signal of length n and cardinality K, whose K nonzero entries 
drawn uniformly at random on the unit £2 sphere. 

A. Phase transition in the noiseless case 

We first study the phase transition properties of HCS and 1-bit CS on quantized recovery 
error and on recovery time in the noiseless case. We conduct HCS and "BIHT+HCS quantizer" 
for 10^ trials. In particular, given fixed n and fc, we uniformly choose 100 different K/n values 
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between and 1, and 100 different m/n values between and 4. For each {K/n,m/n} pair, 
we conduct 10 trials, i.e., HCS recovery and "1-bit CS+HCS quantizer" of 10 n-dimensional 
signals with cardinality K from their m 1-bit measurements. The average quantized recovery 
errors and average time costs of the two methods on overall 10^ {K/n, m/n} pairs for different 
n and k are shown in Figure [2] and Figure [3} 



HCS quantized recovery error (n=512, k=512) BIHT quantized recovery error (n=512, l<=512) 




HCS quantized recovery error (n=512, k=256) BIHT quantized recovery error (n=512, k=256) 




HCS quantized recovery error (n=512, k=128) BIHT quantized recovery error (n=512, k=128) 




Fig. 3. Phase plots of HCS and "1-bit CS+HCS quantizer" in the noiseless case. 

In Figure |2] and Figure [3} the phase plots of quantized recovery error show the quantized 
recovery of HCS is accurate if the 1-bit measurements are sufficient. Compared to "1-bit CS+HCS 
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quantizer", HCS needs slightly more measurements to reach the same recovery precision. That is 
because 1-bit CS recovers the exact signal, while HCS recovers its quantization. Another reason 
is HCS quantizer performs different from uniform linear quantizer when Xi approaching —1 or 
1 for the normalized signal x, which exactly corresponds to the left margin area of the phase 
plot. However, the phase plots of quantized recovery time shows that HCS costs substantially 
less time than "1-bit CS+HCS quantizer". Thus HCS can significantly improve the efficiency of 
practical digital systems and eliminate the hardware cost for additional quantization. 

B. Phase transition in the noisy case 

We also consider the phase transition properties BOl of HCS and 1-bit CS on quantized 
recovery error and on recovery time in the noisy case. The experiments setting up is the same 
as that in the noiseless case except Gaussian random noises are imposed to the input signals. 
The results are shown in Figure |4] and Figure [5j 

Comparing to the phase plots of quantized recovery error in the noiseless case, HCS performs 
much more robust than 1-bit CS. The time costs of HCS shown in Figure |4] and Figure |5] still 
significantly less than that of 1-bit CS. 

C. Quantized recovery error vs. number of measurements in the noisy case 

We then show the trade-off between quantized recovery error and the amount of measurements 
on 2500 trials for noisy signals of different n, K, k and signal-to-noise ratio (SNR). In particular, 
given fixed n, K, k and SNR, we uniformly choose 50 values of m between and 16n. For each 
m value, we conduct 50 trials of HCS recovery and "1-bit CS+HCS quantizer" by recovering 
the quantizations of 50 noisy signals from their m 1-bit measurements. The quantized recovery 
error and time cost of each trial for different n, K, k and SNR are shown in Figure [6] and Figure 

m 

Figure [6] and Figure |7] show the quantized recovery error of both HCS and "1-bit CS+HCS 
quantization" drops drastically with the increasing of the number of measurements. For dense 
signals with large noise, the two methods perform nearly the same on the recovery accuracy. This 
phenomenon indicates that HCS works well on dense signals and is robust to noise comparing 
to CS and 1-bit CS. In addition, the time cost of HCS increases substantially slower than that 
of "1-bit CS+HCS quantizer" with the increasing of the number of measurements. 
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HCS quantized recovery error (n=1024, k=1024, SNR=27.9588) 




HCS quantized recovery error (n=1024, k=256, SNR=27.9588) 




HCS quantized recovery time (n=1024, l<=256, SNR=27.9 



0.5 1 1.5 2 2.5 3 3.5 4 



BIHT quantized recovery error (n=1024, l<=1024, SNR=27.9588) 




BIHT quantized recovery error (n=1024, l<=256, SNR=27.9588) 




0.5 1 1.5 2 2.5 3 3.5 



HCS quantized recovery error (n=1024, l<=128, SNR=27.9588) BIHT quantized recovery error (n=1024, k=128, SNR=27.9588) 




Fig. 4. Phase plots of HCS and "1-bit CS+HCS quantizer" in the noisy case. 



D, Dequantization and consistency 

We finally explore the performance of "HCS+dequantizer" stated in Section 4 and verify 
the consistency investigated in Lemma [TJ In particular, we plot the normalized Hamming loss 
(defined in Lemma [T]) between 74(x*) and A{x) vs. the angular error (49) between x* and x of 
2000 trials for different amount of measurements in Figure [8} 

Figure [S] shows the linear relationship between Hamming error Dh{A{x), and angular 
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Fig. 5. Phase plots of HCS and "1-bit CS+HCS quantizer" in the noisy case. 



error in "HCS+l-bit CS dequantizer", "HCS+midpoint dequantizer" and 1-bit CS 

given sufficient measurements. This linear relationship verifies the "HCS+dequantizer" error 
bound in Theorem [3] and the consistency in Lemma 1 of the Hamming Compressed Sensing 
submission. The figure also shows that "HCS+l-bit CS dequantizer" and 1-bit CS perform better 
than "HCS+midpoint dequantizer". This verifies the effectiveness of "1-bit CS dequantizer". In 
the experiments, the '1-bit CS dequantizer" only requires iterates less than 10 to reach the 
accuracy obtained by 1-bit CS with more than 50 iterates. Thus HCS can significantly save the 
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computation of the subsequent dequantization. 

VI. Conclusion 

We have proposed a new signal acquisition technique "Hamming Compressed Sensing (HCS)" 
to recover the k-bit quantization of a signal x from a small amount of its 1-bit measurements. 
HCS recovery invokes n times of KL-divergence based nearest neighbor searching in a Bernoulli 
distribution domain and requires only nk computations of KL-divergence. The main significance 
of HCS is as follows: 1) it provides a direct recovery of quantized signal from a few measurements 
for digital systems, which has not been thoroughly studied but is essential in practice; 2) it has 
linear recovery time and thus its speed is extremely faster than optimization based or iterative 
methods; 3) the sparse assumption to signal is not compulsive in HCS. Another compelling 
advantage of HCS is that its recovery can significantly accelerate the subsequent dequantization. 
The quantized error bound of HCS for general signals and "HCS+dequantizer" recovery error 
bound for sparse signals have been carefully studied. 
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Fig. 6. Quantized recovery error vs. number of measurements of HCS and "1-bit CS+HCS quantizer" in the noisy case. 
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Fig. 7. Quantized recovery error vs. number of measurements of HCS and "1-bit CS+HCS quantizer" in the noisy case. 
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Fig. 8. Reconstruction angular error vs. measurement Hamming error of "HCS+l-bit CS dequantizer", "HCS+midpoint 
dequantizer" and 1-bit CS in the noisy case. 
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